Modular Dynamic Neural Network: A Continual Learning Architecture

نویسندگان

چکیده

Learning to recognize a new object after having learned other objects may be simple task for human, but not machines. The present go-to approaches teaching machine set of are based on the use deep neural networks (DNN). So, intuitively, solution fly should DNN. problem is that trained DNN weights used classify initial extremely fragile, meaning any change those can severely damage capacity perform recognitions; this phenomenon known as catastrophic forgetting (CF). This paper presents (DNN) continual learning (CL) architecture deal with CF, modular dynamic network (MDNN). presented consists two main components: (a) ResNet50-based feature extraction component backbone; and (b) classification component, which multiple sub-networks progressively builds itself up in tree-like structure rearranges it learns over time such way each sub-network function independently. contribution strongly its training feature. allows classes added while only altering specific previously forgotten. Tests CORe50 dataset showed results above state art CL architectures.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A modular neural network architecture for inverse kinematics model learning

In order to reach an object, we need to solve the inverse kinematics problem, i.e., the coordinate transformation from the visual coordinates to the joint angle vector of the arm. The learning of the inverse kinematics model for calculating every joint angle that would result in a speci"c hand position is important. However, the inverse kinematics function of the human arm is a multi-valued and...

متن کامل

A Neural Network Modular Architecture For Network Traffic Management

With the rapid evolution of telecommunication networks, real-time traffic management is becoming more and more crucial. We propose here a neural network modular architecture for performing diagnosis at different levels of the telephone network. This system is designed as an aid to the operator. We present results of different experiments with a first version of the architecture which mainly ope...

متن کامل

Continual Robot Learning withConstructive Neural

In this paper, we present an approach for combining reinforcement learning, learning by imitation, and incremental hierarchical development. We apply this approach to a realistic simulated mobile robot that learns to perform a navigation task by imitating the movements of a teacher and then continues to learn by receiving reinforcement. The behaviours of the robot are represented as sensation-a...

متن کامل

A Parallel and Modular Multi - Sieving Neural Network Architecture for Constructive Learning

In this paper we present a parallel and modular multi-sieving neural network (PMSN) architecture for constructive learning. This PMSN architecture is dierent from existing constructive learning networks such as the cascade correlation architecture. The constructing element of the PMSNs is a compound modular network rather than a hidden unit. This compound modular network is called a sieving mod...

متن کامل

Modular Continual Learning in a Unified Visual Environment

A core aspect of human intelligence is the ability to learn new tasks quickly and switch between them flexibly. Here, we describe a modular continual reinforcement learning paradigm inspired by these abilities. We first introduce a visual interaction environment that allows many types of tasks to be unified in a single framework. We then describe a reward map prediction scheme that learns new t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied sciences

سال: 2021

ISSN: ['2076-3417']

DOI: https://doi.org/10.3390/app112412078